Journal of Knowledge Management Practice,

Historical attempts to impose rigid data-based practice and performance standards in the delivery of healthcare have met with resistance from providers, though the personalized nature of healthcare practice required little need for rigorous data quality assessment in daily practice. The rapid adoption of evidence-based decision support systems at the provider level, however, now suggests that the application of data quality improvement is less likely to be found objectionable in the establishment of standards for information application and management in health care. Such an information-intensive environment requires a system of formal, continuous data quality assessment in service delivery and quality management. Data Quality Assessment Methods in Healthcare Information Systems On analysing types of methods favored by early adopters of formal data quality assessment in healthcare organizations, one sees that historically, a reactive, problem-based approach has been the norm for the assessment and measurement of information accuracy. With the emergence of evidence-based, data-driven medicine in the U.S. however, the representation of the patient, and ultimately the organization’s measured quality of care, is primarily represented by data rather than intensive, personal interaction with the patient (1994). As such, the quality of data maintained by the organization becomes a critical factor in the ultimate delivery of care, and the need for more rigorous quality assessment methodologies becomes apparent, requiring the inclusion of assessment of data comprehensiveness, consistency, currency, relevance, and timeliness (Agmon, 1987). Past attempts to impose rigid data-based standards in the application of clinical judgement have met resistance from healthcare providers, and thus the need for rigorous data quality assessment was of little consequence. Today, with the increasing deployment of decision support systems at the provider level, application of data quality improvement is less likely to be found objectionable in the establishment of standards for information application and management in health care, in both the care and treatment of patients as well as the management of the system where they are treated . Such an information-based scheme now requires a system of continuous data collection, evaluation, feedback, and adjustment of the health care process (Ballou, D. 1985). A number of quality improvement measures have been attempted in response this development, including the use of health outcomes data in clinical practice, which are objective measures of post-treatment health, based on defined criteria . Commonly, large outcomes databases of similar procedures are maintained and analyzed statistically to provide the patient with an objective prognosis for success or failure (Fennell, 1988). So a patient contemplating heart surgery, for example, can compare himself to other patients with similar characteristics who have undergone the surgery, and obtain a statistical prediction of success with the surgery, as well as chances for survival without it. Outcomes databases are being compiled by surveying patients after surgery on their quality of life, which examines indicators other than medical symptoms, such as mobility or social activity. This information is becoming more accessible to office-based providers for use as reference points or data quality benchmarks in providing day-to-day treatment. The availability of rich data sets makes it likely that U.S. medicine will continue to move to data-drive, Journal of Knowledge Management Practice, http://www.tlainc.com/articl20.htm 2 of 12 12/28/2005 6:53 PM evidence-based medicine. Sophisticated Electronic Data Interchange (EDI) networks, as well, are being more widely adopted as both automated claims processing systems and financial analysis resources. Data quality indicators have been developed related to the standardization of patient information and the formatting and submission of data, along with payment standards through electronic funds transfer and communication with providers through electronic mail. Likewise, standards for uniformity of clinical records are actively being pursued . Such systems are designed to create a paperless claims system, and create a comprehensive database of healthcare practices and outcomes involving Medicare recipients. The American National Standards Institute (ANSI), among others, are actively developing system standards for this process (Huh, 1990). The growing adoption of evidence-based medicine further promotes the use of data-driven decision-making, or the use of current best evidence in making decisions about the care of individual patients. The practice of evidence-based medicine relies on integrating individual clinical experience with the best available external clinical research evidence. In day to day practice, reliable data quality can enhance the judgement that individual clinicians acquire through training and practice. Increased clinical performance is thus achieved in many ways, but especially in better-informed diagnosis and in more complete identification of treatment options and application of an expanded knowledge based in day-to-day practice. High quality external treatment data, which applies clinical research in routine practice, is integrated into patient-centered clinical research, incorporating such concepts as accuracy and precision of diagnostic tests (including the clinical examination), the power of outcomes-based diagnostic indicators, and the efficacy and safety of therapeutic, rehabilitative, and preventive regimens. All types of evidence, ultimately, are derived from raw data, and the quality assurance of such data is a prerequisite for the adoption of evidence in clinical practice. Data and Methodology Data from a nationwide survey of healthcare information managers, the AHA Annual Survey, the U.S. census, Interstudy publications, state and regional health service departments, and The Market Statistics Report were used to examine the organizational and environmental characteristics of data quality in a variety of healthcare settings. A comparison of selected data quality characteristics was made across practice settings, geographic areas, and selected healthcare demographic characteristics. The survey data include measures of the quality of data obtained via automated encoders, the impact of organizational mergers and acquisitions on data quality, and the existence of an organizational data quality committee or team. The survey further identify the existence of a data quality manager, the most common methods used for identifying data quality problems, and the use of edit checks in automated data fields. Finally, the data provide measures of the existence of organizational master data dictionaries, the existence of organizational policies and procedures related to the timeliness of data capture, and the existence of an organizational process to identify and prioritize data acquisition. Preliminary findings from the survey were summarized for analysis and are reported elsewhere (1999). Design and Methodology The survey, completed in May of 1999, was a response to the need of the healthcare industry for more timely and frequent practice information in the field of health information management No comprehensive study of this kind has been available in the past. The goal of this undertaking was to establish a source of practical, comparative information that can be used in both strategic planning and day-to-day practice. This project was designed to allow ready access to ideas Journal of Knowledge Management Practice, http://www.tlainc.com/articl20.htm 3 of 12 12/28/2005 6:53 PM and innovations that other professionals have used in solving management and technology problems common to many organizations. This study was designed to provide periodic information on a range of information management topics, such as clinical coding, reimbursement, compliance, health record computerization, and data quality. In addition, a portion of the survey was devoted to collecting information about the professional issues facing practicing managers. Sample Design The initial survey was initially fielded in June 1998, with follow-up assessments accomplished through May 1999. It was designed to provide representative information on the population of health information managers. The sample included respondents from a variety of practice settings and job titles and excluded students. The survey obtained data from 16,591 health information managers, for a 50.4 percent gross response rate Samples for surveys were selected from a database of certified health information managers provided by the Foundation for Record Education , and contained current and historical information on RRA/ART credentialed information professionals in the United States. The data included on the population surveyed were obtained primarily from membership renewal forms and from an annual member profile mailed to all active members. Preferred mailing address data were obtained from the member population from those members with changes in address or professional status. These changes may be signaled by input from periodic mailings or by other correspondence. Questions for the main questionnaire were developed from a review of past surveys and focus group results. Questions in the survey were designed so that managers from a variety of practice settings and work roles were asked questions that were generally relevant to the profession overall. Work settings captured in this study included the following: Ø Hospitals and medical centers Ø Group practices Ø Ambulatory care clinics Ø Managed care offices Ø Long-term care and rehabilitation facilities Ø Colleges and universities Ø Consulting firms Ø Government agencies Ø Software product companies Ø Pharmaceutical companies Ø Self-employed HIM professionals Ø Other work settings Journal of Knowledge Management Practice, http://www.tlainc.com/articl20.htm 4 of 12 12/28/2005 6:53 PM Topics were formulated and pre-tested by convened groups of practicing information managers to represent a broad range of activity areas. Questions that had not been used previously in any known surveys of health information professionals were pre-tested prior to the survey fielding to evaluate the wording and ordering of questions and to determine the ability of respondents to provide the desired information. Field Procedures Prior to the survey mailing, announcements were made through professional publications and meetings to inform members of the upcoming survey. A preprinted questionnaire was mailed to all credentialed health information managers who had identifiable mailing addresses. An instruction letter accompanied the form and explained the purpose of the survey and instructions for completion. At the six-week point following the last wave of the initial mailing, a second mailing was sent to those who had not responded. Follow-up on specific issues identified after the second mailing was accomplished as a series of more focused studies, reported elsewhere. The questionnaires were processed by an independent testing and research firm, National Computer Sytems of Minneapolis, MN, which processed forms weekly over the length of the study. Region-specific response rates were tracked to ensure that the mailings were received in a timely manner. Strict adherence to confidentiality standards was maintained in this study. Data were entered via a computerized scanning system and released only in aggregate form, without individual respondents identified within the reported results. In addition, a number of data quality control measures were employed to provide the cleanest possible data. A detailed review was made of all sample response dispositions, both pending and final, on a weekly basis. From this evaluation, the time schedule was reviewed and necessary recommendations were made to the contractor to enable the survey to be completed during the allotted field period. As part of the post-survey program review, the design and methodology were examined to identify areas needing improvement. After data entry was complete, an evaluation was made of the impact of survey and item non-response rates and various potential methods for adjusting results to correct for non-response. Respondents in this study were asked: 1. What is the most common way you identify data quality problems? · Errors reported from analysis of aggregate data · Data completeness edits when data is transferred from one system to another · Errors reported on individual records · User complaints caused by unavailable information · Data quality edits when data is transferred from one system to another · External data audits · Internal data quality audits 2. What percentage of automated data fields captured employ edit checks to improve data quality? Journal of Knowledge Management Practice, http://www.tlainc.com/articl20.htm 5 of 12 12/28/2005 6:53 PM · 0-5% · 5-10% · 10-20% · 20-30%